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Further,  the  plant  may  have  a number  of  input  and 
output  variables  in  which  case  it  is  termed  multi- 
variable.  It  is  Important  to  make  the  distinction 
between  the  identification  problem  and  the  simi- 
lar, but  Inverse,  problem  of  output  estimation. 

In  estimation,  the  physical  relationship  between 
the  input  and  output  is  given  (known)  and  either 
a filtered  or  predictive  estimate  of  the  output 
is  desired.  The  problem  that  is  generally 
referred  to  as  "optimal"  requires  a statistical 
description  of  all  noise  and  disturbance  processes 
Introduced  into  the  system. 


Abstract 


Instrumental  variable  (IV)  regression  is  applied 
to  the  estimation  of  the  parameters  of  a differ- 
ence equation  model  of  a process  subject  to  noise. 
The  technique  preserves  the  simplicity  of  least- 
squares  estimation,  and  is  shown  to  significantly 
reduce  the  bias  on  the  parameter  estimates  caused 
by  measurement  noise.  A second-order  example  is 
used  to  illustrate  the  performance  of  the  IV 
estimator,  and  to  study  the  selection  of  sample 
time  and  initialization  parameters.  Demonstration 
is  given  on  the  parameter  tracking  capability  of 
the  dynamic  form  of  the  algorithm.  The  dynamic 
algorithm  is  Important  for  use  in  adaptive 
control. 


More  specifically,  the  following  identification 
problem  is  considered.  Given  the  discrete-data 
record  of  a sequence  of  inputs  (u(t);  t-l,2,...,K) 
or  (u(t))^  and  the  corresponding,  disturbance- 
corrupted  outputs  (y (t) }R  of  a dynamical  system, 
determine  the  parameters  of  a suitable  linear 
model  to  be  fitted  to  the  data  record.  The  number 
of  observations,  K,  is  larger  than  the  number  of 
parameters  to  be  estimated. 


Introduction 


Today,  with  the  aid  of  an  on-line  digital  com- 
puter, it  is  possible  to  use  an  empirical  model 
to  represent  a non-linear  plant  in  a sequential 
manner.  Specifically,  a low-order  linear  model 
is  selected  to  represent  the  dynamic  system.  By 
use  of  the  proper  estimation  algorithm,  the  com- 
puter is  able  to  produce  updated  parameter  esti- 
mates for  the  empirical  model  at  each  sample 
Instant.  With  this  quasi-linearization  procedure 
it  is  now  feasible  for  the  engineer  to  character- 
ize the  dynamics  of  his  process  sufficiently  to 
be  able  to  apply  such  advanced  control  techniques 
as  the  self-adaptive  strategy. 


To  be  of  practical  use  in  an  adaptive  control 
strategy,  the  problem  as  stated  is  too  general  and 
further  restrictions  are  needed.  Some  major 
requirements  of  adaptive  philosophy  are:  (1)  that 

Identification  be  performed  "on-line”  and  in  the 
presence  of  the  system's  normal  operating  signals 
and  disturbances,  using  only  the  normal  control 
inputs;  (2)  that  the  computation  time  for  identi- 
fication be  reasonably  short  compared  to  the 
sampling  time  required  to  maintain  good  control; 

(3)  that  the  computation  time  be  short  compared  to 
the  rate  of  variation  of  the  process  parameters; 

(4)  that  data  storage  be  minimal.  These  require- 
ments suggest  a recursive  technique  which  is  capa- 
ble of  improving  its  estimates  as  more  data  is 
received  and  is  able  to  detect  parameter  variation 
at  the  same  time.  The  general  approach  is  then  a 
quasi-linearization  procedure  which  yields  a model 
of  the  plant  at  each  sampling  Instant. 


This  paper  presents  one  method  of  process  identi- 
fication - namely,  the  instrumental-variable 
method.  This  method  can  be  used  to  estimate  model 
parameters  from  an  array  of  linear  algebraic  equa- 
tions involving  these  parameters,  a set  of  obser- 
vations, and  a set  of  unobservable  noise  terms. 

The  estimates  are  obtained  by  first  multiplying 
the  array  by  a rectangular  matrix  of  "instruments" 
to  yield  a square  invertible  matrix  which  is  then 
solved  for  the  estimates. 


Specification  of  the  Model 


The  first  step  of  the  identification  problem  is 
the  specification  of  an  algebraic  structure 
between  the  input  and  output  variables.  This 
model  is  postulated  a priori  and  stems  from  the 
underlying  theory  governing  the  particular  dynamic 
system  under  investigation.  Because  most  adaptive 
control  and  optimization  problems  are  time-varying 
and/or  nonlinear,  convenience  has  replaced  the 
classical  frequency-domain  analysis  with  time- 
domain  methods.  Of  these,  discrete-time  methods 
are  preferred  when  the  data  records  are  obtained 
by  sampling  the  input  and  output  signals  at  regu- 
lar intervals.  Since  this  is  the  manner  In  which 


Definition  of  the  Problem 


Stated  simply,  process  identification  is  the  prob- 
lem of  determining  a description  of  the  relation- 
ship between  the  input  and  output  variables  of  the 
process.  The  fact  that  the  unknown  plant  has  been 
selected  for  study  may  suggest  non-linear  behav- 
ior, time-variable  parameters,  or  simply  a linear 
system  operating  in  an  extreme  environment. 
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the  data  are  gathered  by  on-line  digital  computers, 
the  most  convenient  model  is  in  the  form  of  dif- 
ference equations. 


With  reference  to  the  identification  scheme 
sketched  in  Figure  1,  the  following  difference 
equation  can  be  used  to  represent  the  relationship 
between  the  single  input  and  the  single  distur- 
bance-free output,  ct[l]: 

ct  ■ Vt-i + Vt-2 + ••• + Vt-p + Vt-M-i 


+ b2ut-M-2  + 


+ b 


q t-M-q 


(1) 


The  Structural  Relationship 

It  would  at  first  seem  proper  to  estimate  the 
model  parameters  of  Equation  3 by  application  of 
either  ordinary  least-squares  (LS)  or  generalized 
least-squares  (GLS) . The  choice  would  appear  to 
depend  upon  the  particular  assumptions  made  on 
the  disturbance  term.  The  danger  implicit  in  this 
procedure  has  been  pointed  out  by  Young  [2]. 
Equation  3 does  not  represent  the  simple  regres- 
sion model  upon  which  the  least-squares  theory  is 
based,  but  Instead  contains  "errors  in  variables" 
within  the  xt  vector  and  is  known  as  a "structural 
model"  [3]. 


where  M represents  the  process  dead  time  in  inte- 
ger multiples  of  the  sample  interval,  T,  and  p 
and  q are  the  number  of  output  and  input  terms 
respectively.  It  is  generally  accepted  that,  for 
process  control  applications,  the  model  need  not 
be  of  order  higher  than  second  (p  • 2,  q « 2). 

Equation  1 can  be  expressed  in  compact  vector  (or 
matrix)  notation  as  follows: 

ct  ’ V't-l*  * “ (2) 

where 

cp  - [aia2  ...  apbxb2  ...  bq] 

Vl  “ [ct-l  Ct-pUt-M-l  ”•  “t-M-q1 

If  Cg  could  be  measured  without  error  and  the 
model  fit  the  process  exactly,  then  only  (p  + q) 
sets  of  data  (observations)  would  be  required  to 
determine  the  model  parameters  exactly.  That  is 
(p  + q)  observations  would  give  (p  + q)  equations 
with  as  many  unknowns.  In  practice,  however, 
there  exist  three  major  sources  of  uncertainty, 
namely: 

(1)  The  inability  of  the  model  to  describe  the 
process  exactly, 

(2)  The  disturbances  entering  the  process  (wj  in 
Figure  1) , and 

(3)  The  presence  of  measurement  noise,  wn< 

To  account  for  these  uncertainties,  equation  2 can 
be  extended  as  follows: 

yt  " “Vl  + Wt  (3) 

where 

Vl  ’ tyt-l  •'*  VpUt-M-l  “t-M-q1* 

The  term  wt  represents  more  than  just  the  simple 
combination  of  wj  and  wn.  As  the  vector  x of  past 
input-output  observations  contains  now  the  noise- 
corrupted  measurements  (y)  rather  than  the  true 
plant  output  (c),  wt  would  be  correlated  even  if 
wj  and  wn  are  not. 


The  elements  of  the  observation  vector  xt  consti- 
tute what  are  called  explanatory  variables 
(Independent  variables)  and  application  of  LS 
requires  that  these  variables  be  known  exactly 
(deterministic)  or  at  least  be  uncorrelated  with 
the  disturbance  term  if  the  explanatory  variables 
are  themselves  random.  That  is,  it  must  be 
assumed  that 

ElwtXtJ  ” 0 

for  consistency,  if  not  unbiasedness.  Now,  the 
vector  x*  contains  passed  values  of  the  input  and 
output  of  the  process.  These  passed  values  are 
known  as  "lagged"  variables.  The  passed  values 
of  the  input  are  lagged  values  of  the  Independent 
variable  and  cause  no  difficulty  for  open-loop 
identification.  Lagged  values  of  the  output 
(dependent)  variable,  on  the  other  hand,  represent 
a really  troublesome  obstacle  - namely,  that  the 
explanatory  variables  are  correlated  with  the  dis- 
turbance term.  Using  the  results  of  simple  linear 
regression  analysis  in  this  case  will  result  in 
estimates  which  are  biased  in  finite  samples  to  a 
degree  dependent  on  the  noise-to-signal  ratio.  If 
in  addition,  the  disturbance  term  is  autocorre- 
lated,  then  the  combination  of  lagged  variables 
and  autocorrelated  disturbances  result  in  the  LS 
estimator  being  inconsistent  [4].  Hence,  in  any 
application  of  LS  theory,  it  must  be  assumed  that 
the  conditions  for  the  validity  of  the  results  are 
satisfied. 

Survey  of  Estimation  Methods 

In  the  last  section,  the  problems  encountered  in 
the  application  of  classical  regression  to  the 
structural  model  of  Equation  3 were  discussed. 

The  technique  of  GLS  requires  conplete  specifica- 
tion of  the  disturbance  for  direct  estimation  of 
the  model  parameters.  An  on-line  GLS  method  of 
estimating  the  coefficients  of  a signal  processing 
filter  to  approximate  the  disturbance  is  presented 
by  Hastlngs-James  and  Sage  [5]. 

There  are  two  main  estimation  methods  which  can  be 
utilized  with  the  structural  model.  One  is  the 
instrumental  variable  (IV)  approach.  The  other 
technique  is  the  method  of  maximum  likelihood 
estimates.  This  method,  originally  developed  for 
off-line  computation,  carries  fairly  strong  assump- 
tions about  the  covariance  matrix  of  noise  - 
namely,  all  the  random  variables  Involved  are 
assumed  to  be  Gaussian.  Moreover,  initial  guesses 
of  the  parameters  must  be  made  close  to  the  true 
values  in  order  to  guarantee  convergence. 


2 


Two  recent  papers  [6,7]  deal  specifically  with  the 
comparisons  of  the  performance  and  computational 
expense  of  all  the  Important  on-line  Identifica- 
tion methods.  Isermann  et  al.  [6]  concluded  that 
identification  methods  using  the  same  a priori 
Information  of  the  process  model  results  In  about 
the  same  performance.  If  the  "laws  of  good  identi- 
fication" are  applied.  They  suggest  that  the  key 
to  selection  of  an  identification  method  rest  on 
such  factors  as  the  kind  of  input  signal,  the 
computational  expense,  the  overall  reliability  and 
the  necessary  assumptions  required. 


yk 

“ lyly2  ' 

...  yK] 

*K-1 

■ 'Vi  ■ 

...  x^J  (a  (p+q)xK  matrix) 

WK 

‘ [W1W2  ' 

...  wR] 

This 

equation 

is  now  post  multiplied  by  a trans- 

formation  matrix,  z£: 

Vk-1  - *kWk-1  + WKZK-1 


Instrumental  Variable  Estimator 

The  difficulties  encountered  In  obtaining  an 
unbiased,  minimum  variance  estimator  are  attri- 
buted to  the  correlation  arising  between  wt  and 
xt_l  of  the  structural  model  of  Equation  3.  The 
Instrumental  variable  (IV)  approach  to  parameter 
estimation  was  first  introduced  In  the  early 
1940's  in  an  area  of  economics  now  known  as 
econometrics  [8].  The  method  was  specifically 
designed  to  deal  with  the  errors-in-variables 
problem,  l.e.,  the  errors  associated  with  the 
explanatory  variables  in  regression  calculations 
[3,9],  The  IV  method  is  Intended  as  a compromise 
between  the  range  of  techniques  from  largely 
deterministic  procedures  to  sophisticated  statis- 
tical methods  based  on  the  results  of  optimal 
estimation  theory. 

The  first  use  of  the  IV  approach  in  the  field  of 
process  identification  is  generally  attributed  to 
Joseph  et  al.  [10].  They  suggested  an  IV  proce- 
dure utilizing  the  Input  variable  ut  as  the  instru- 
ments for  Identifying  the  parameters  of  a process 
described  by  a difference  equation  model.  Andeen 
and  Shipley  [11]  reported  an  essentially  similar 
technique  of  the  Joseph  et  al.  method  with  an 
added  prefilter  to  improve  the  accuracy  of  estima- 
tion in  the  presence  of  noise.  Levadl  [12] 
presented  a purely  analog  IV  method  for  identify- 
ing a linear  dynamic  process  described  by  a dif- 
ferential equation  model.  Wong  and  Polak  [13] 
showed  that  there  exist  optimal  instrumental 
variables  and  they  approximated  the  optimal  vari- 
ables with  the  calculated,  undisturbed  output  of 
an  auxiliary  model.  In  turn,  the  parameter  esti- 
mates were  used  to  update  the  auxiliary  model. 

Young  [14]  presented  a hybrid  development  of 
Levadl 's  purely  analog  approach  and  introduced  a 
time  delay  and  a low  pass  filter  before  updating 
the  auxiliary  model  to  ensure  that  the  model 
parameters  were  not  correlated  with  wt  at  the  same 
instant  and  to  smooth  the  estimates.  In  addition, 
Young  presented  the  dynamic  form  of  the  IV  algo- 
rithm and  discussed  its  relationship  to  the  Kalman 
filter  equations.  Rowe  [15]  extended  the  estima- 
tor to  the  multivariable  case  and  Included  a 
spectral  factorization  technique  for  identifying 
part  of  the  correlated  disturbance. 

The  Instrumental  variable  technique  is  best  dis- 
cussed in  terms  of  the  regression  equations. 
Application  of  Equation  3 to  the  K sets  of  obser- 
vations results  in  the  following  matrix  equation: 

* VSc-1  + WK  <*> 


This  transformation,  or  Instrumental  variable, 
matrix  is  chosen  which  satisfies 


ElW^-i]  - 0 


(6) 


T 

E^XK-lZK-l^  nonsingular 
T 

The  elements  of  Z^  are  therefore  chosen  to  be 
uncorrelated  with  the  disturbance  W^,  and  at  the 
same  time,  highly  correlated  with  the  regressors 
in  X](_i.  Solving  Equation  5,  the  IV  estimate  is 
given  by 


*K  ' YKZK-1  [XK-1ZK-Irl  (7) 

T 

If  the  observation  matrix,  Xg_^,  is  used  as  the  IV 
matrix,  LS  estimation  results,  thus  becoming  a 
special  case  of  the  IV  approach.  Therefore,  by 
proper  choice  of  an  IV  matrix,  it  is  possible  to 
eliminate  the  bias  due  to  the  combination  of  noise 
and  lagged  variable  regressors  while  preserving 
the  simplicity  of  least-squares  estimation. 

Unfortunately,  the  universal  law  of  the  conserva- 
tion of  "advantage"  is  valid  in  this  instance. 

The  law  states  that  to  gain  an  advantage  in  one 
azea  requires  a proportional  disadvantage  be 
established  in  another  area.  In  this  instance, 
the  elimination  of  asymptotic  bias,  i.e.  consis- 
tency, is  accompanied  by  a certain  loss  of 
efficiency  in  the  statistical  sense.  IV  estima- 
tors lack  efficiency  because  they  make  use  of  only 
a limited  amount  of  a priori  information.  But  the 
lack  of  a priori  disturbance  statistics  was  the 
major  reason  for  selecting  the  IV  approach.  So 
efficiency  has  not  really  been  lost  - the  problem 
requirement  is  simply  more  demanding.  And  as 
might  be  expected,  the  greater  the  correlation 
between  the  instrumental  variable,  zt,  and  the 
noise-free  signals,  ct,  the  smaller  the  estimation 
variance.  Finally,  a small  bias  will  remain  due 
to  finite  sample  lengths. 


Since  a major  advantage  of  the  IV  method  is  the 
preservation  of  the  simple  least-squares  structure, 
the  recursive  or  sequential  form  of  Equation  7 is 
desirable.  The  recursive  relations  are 

vi  ■ »t+(jwVt)li^t-i,t|‘1,!?t.i  (8) 

pt  • pt-rpt-ixtI1+*tpt-ixt,"1*t|,t-i  (9) 


where 


where 


t-1 


'Vi’Li1'1 


A diagram  for  the  sequential  IV  estimator  is  shown 
in  Figure  2.  Wong  and  Polak  [13]  and  Rowe  [15] 
have  pointed  out,  in  regard  to  the  selection  of 
zt,  that  the  direct  GLS  estimator  represents  the 
optimal  IV  estimator.  Referring  to  Figure  2,  this 
Implies  the  use  of  ct+i  as  the  instrumental  vari- 
able which  in  turn  implies  the  precognitive  solu- 
tion to  the  problem  by  requiring  complete  a priori 
information  on  the  noise  statistics.  Utilization 
of  the  output  of  an  auxiliary  model,  as  indicated, 
represents  a close  approximation  to  ct+j.  A by- 
product of  this  procedure  is,  of  course,  filtered 
estimates  of  the  system  output. 

Parameter  Tracking 

A decided  advantage  of  the  recursive  relations  of 
Equations  8 and  9 over  their  nonrecursive  counter- 
parts is  that  it  is  no  longer  necessary  to  store 
and  perform  calculations  on  large  quantities  of 
data.  The  data  is  reduced  at  each  sample  instant 
and  is  accumulated  with  past  reduced  data  in  the 
considerably  compact  weighting-matrix,  PK.  Hence 
the  PK  matrix  represents  a concise  history  of  the 
observations.  The  weighting-matrix  is  therefore 
the  key  to  parameter  tracking. 

Relations  like  Equations  8 and  9 represent  finite- 
time averaging  operations  in  which  all  data  is 
weighted  equally  over  the  observation  Interval  of 
K samples.  An  important  assumption  implicit  in 
this  operation  is  that  the  unknown  parameters  are 
constant  over  the  observation  set  [2].  It  then 
follows  that  in  order  to  detect  parameter  varia- 
tion, it  is  necessary  to  shorten  the  memory  of  the 
estimation  procedure  so  that  new  observations  are 
given  more  weight  than  outdated  observations. 

One  approach  to  parameter  tracking  is  obtained  by 
weighting  the  data  exponentially  into  the  past  to 
gradually  remove  Information  as  it  becomes  obso- 
lete. Examination  of  Equation  9 for  the  finite- 
time averaging  case  will  show  that  PK  is  strictly 
a decreasing  function  of  time.  After  a large 
number  of  samples  (large  K)  have  been  collected, 

PK  may  diminish  to  the  extent  that  new  data  no 
longer  Influences  the  estimates.  Thar,  is,  due  to 
the  averaging  process,  individual  samples  have 
less  effect  on  the  estimates  as  the  number  of 
samples,  K,  increases.  The  physical  effect  of 
exponential  weighting  the  data  is  to  set  a lower 
bound  on  PK  so  that  new  data  continues  to  influ- 
ence the  estimates  via  Equation  8 [16]. 


When  the  structure  of  the  stochastic  parameter 
variation  model  is  not  known,  a simplified  form 
may  be  given  by: 

*t  ■ Vi  + ’t-1  (11 

The  dynamic  IV  algorithm  is  correspondingly  sim- 
plified to 


Vi  ■ V(yt+iAxt)I1+*tpt/t-ixtrlitpt/t-i  <u> 


t/t-1 


pt-l + D 


(12) 


pt ' pt/t-rpt/t-ixt[1+ztpt/t-ixt]'lztpt/t-i  (13> 


where  P . ^ is  the  a priori  update  of  P at  time 

t,  baselron  observations  up  to  and  including  y . 
The  only  difference  between  this  dynamic  algorithm 
and  the  static  scheme  of  Equations  8 and  9 is  the 
addition  of  Equation  12.  The  D matrix  simply  adds 
the  necessary  lower  bound  to  P so  that  the  algo- 
rithm can  track  parameter  variations. 


Although  this  is  the  same  result  obtained  by  expo- 
nential weighting  the  data,  the  dynamic  approach 
has  more  inherent  flexibility  and  is  more  easily 
Implemented.  Since  D is  a matrix  it  is  possible 
to  limit  individual  elements  to  different  degrees. 
For  example,  if  certain  parameters  are  known  to  be 
time-invariant,  then  the  corresponding  elements  of 
D would  be  zero.  Further,  the  model  approach 
allows  any  a priori  information  that  is  available 
to  be  used  in  the  estimation  algorithm.  Young 
[14]  illustrates  this  last  point  by  including  in 
the  estimation  additional  measured  data  obtained 
from  the  process. 


Computational  Results 

The  results  presented  here  are  based  on  the  second- 
order  plant  described  in  Table  I.  The  system  was 
forced  with  discrete  white  noise,  i.e.,  a pseudo- 
random-binary-sequence (PRBS) , with  a clock 
interval  equal  to  the  sample  interval  T.  For 
details  on  this  type  of  input  signal  see  Eveleigh 
[20]  or  Davies  [21].  The  PRBS  starter  sequence 
was  not  varied  between  runs  so  that  the  input 
would  be  reproducible. 


TABLE  I 

Second  Order  Plant 
The  Second-Order  Linear  Process 


It  is  Important  to  point  out  that  this  approach 
has  the  disadvantage  that  the  effects  of  noise 
will  also  be  detected  and  used  to  modify  the  esti- 
mates. It  will  therefore  be  necessary  to  assume 
that  the  parameter  variations  are  larger  then  the 
residual  fluctuations  due  to  noise. 


c 


u ( t ) 


results  in  the  following  difference  equation 

parameters: 


An  alternative  to  exponential  weighting  the  data 
for  parameter  tracking  is  to  describe  the  para- 
metric variation  by  a suitable  stochastic  model. 
Lee  [17]  points  out  that  the  resulting  algorithm 
is  not  optimal  and  its  only  Justification  is  that 
"It  works".  It  is  interesting  to  note  that  this 
approach  results  in  a prediction-correction 
algorithm  which  is  a special  form  of  the  Kalman 
filter  equations  [18,19]. 


ax  - 0.97441  bx  - 0.15482 

a2  - -0.22313  b2  - 0.09390 


for  a sample  Interval  T « 1.  The  time  constants 
and  gain  are 


k - 1 


Measurement  noise  was  simulated  as  discrete  white 
noise,  v(t),  generated  by  a pseudo-random  number 
generator  routine.  The  routine  generated  uni- 
formly distributed  real  numbers  which  were  then 
transformed  Into  a normally  distributed  random 
number  sequence  with  a given  mean  and  a standard 
deviation.  The  noise-to-signal  ratio,  6,  is 
defined  as: 


, _ r.m.s.  value  of  the  noise.  w(t) 
r.m.s.  value  of  the  signal,  c(t) 


(1A) 


The  criterion  used  to  evaluate  estimation  perfor- 


lent  results  (less  than  0.00S  after  250  samples) 
are  still  obtained  within  the  band  of  T ■ 0.25  to 
T - A.O. 

A study  was  made  to  determine  how  the  optimum 
sample-interval  band  depended  upon  the  ratio  of 
the  two  time  constants  of  the  plant.  The  results 
presented  in  Figure  A had  a time  constant  ratio  of 
Tj/x^  • 0.5.  The  cases  were  obtained  with  Tj  main- 
tained at  2.0  and  ^ varied  to  give  the  selected 
ratios.  The  following  results  are  reported  for 
the  sample  interval  range  for  which  e is  less  than 
0.005  after  250  samples. 


mance  is  the  "estimation  error  fraction" , 
as 

defined 

Ratio 

Range  of  T 

l!<p  - <p ,11 

0.25 

0.2  to  1.5 

C - 

H5) 

0.50 

0.25  to  A.O 

II*  - *0II 

0.75 

0.25  to  A.O 

1.00 

0.30  to  3.5 

where  tfi  Is  the  true  system  parameter  vector  and 
and  are  the  estimates  at  time  t and  0.  Notice 
that  It  Is  possible  In  this  case  to  define  e 
because  the  true  system  parameters,  given  In  Table 
I,  are  known.  The  scalar  e represents  the  normal- 
ized vector  norm  of  the  estimation  error  in  the 
parameter  space.  The  Initial  parameter  guesses, 
$c,  are  taken  as  zero. 


The  conclusion  Is  that  the  sample  time  selection 
is  not  sensitive  to  the  time  constant  ratio.  This 
result  Is  significant  because  it  will  facilitate 
the  estimation  of  a process  whose  time  constants 
are  changing. 

Algorithm  Initialization 


Comparison  with  Least  Squares 

Figure  3 shows  the  estimation  error  fraction  for 
the  LS  estimator  and  the  IV  estimator  for  a noise- 
to-signal  ratio  of  0.0655.  As  predicted,  the  IV 
estimator  outperforms  the  LS  estimator.  The 
Improvement  is  greater  the  larger  the  signal  to 
noise  ratio,  and  the  two  methods  are  equivalent 
for  6-0,  i.e.,  the  noise-free  system. 

Multlcolllnearlty  and  Selection  of  Sample  Rate 

One  of  the  basic  assumptions  underlying  the  appli- 
cation of  LS  or  IV  estimation  to  the  difference 
equation  model  is  that  the  observation  matrix  X 
(see  Equation  A),  which  is  of  order  t(p  + q)  x K], 
has  rank  (p  + q).  This  would  not  be  the  case  If 
some  or  all  of  the  explanatory  variables  are  per- 
fectly correlated,  a condition  known  as  multi- 
collinearlty  [22],  As  the  degree  of  correlation 
between  the  explanatory  variables  Increases,  the 
moment  matrix,  [XZ^],  becomes  Ill-conditioned  and 
approaches  singularity. 


The  recursive  IV  algorithm  must  be  initialized  by 
specification  of  the  initial  weighting  matrix,  P0, 
and  the  Initial  parameter  estimate,  <f0.  In  his 
chapter  on  identification  using  LS  estimation, 

Lee  [17]  suggests  a mathematical  trick:  that  the 

computation  process  be  initiated  with  P0  set  to  al 
where  I is  the  Identity  matrix  and  a Is  large,  so 
that  It  does  not  matter  what  value  is  used  for  <P0 
because  the  algorithm's  "memory"  is  so  short  that 
it  ignores  the  Initial  parameter  estimate.  Hence, 
any  value  may  be  used  and  zero  is  as  good  as  any 
other.  On  the  other  hand,  this  suggests  that  if  a 
reasonably  good  guess  can  be  made  of  $0,  then  this 
confidence  should  be  reflected  In  P„  by  lowering 
the  value  of  u.  The  effect  of  noise  on  the  selec- 
tion of  a was  studied  for  IV  estimation.  The 
results  are  shown  In  Figure  5.  These  results  show 
that  the  value  of  a has  a pronounced  effect  on  IV 
estimations.  In  fact,  If  a Is  chosen  to  be  too 
high  for  a given  6,  the  IV  method  may  not  converge 
at  all.  However,  we  found  that  If  a is  chosen 
properly,  the  results  of  IV  estimation  are  much 
Improved  over  the  LS  method  when  measurement  noise 
is  present. 


As  the  sample  rate  is  Increased,  correlation 
between  successive  values  of  the  output  Increases, 
since  they  become  close  to  each  other  in  time. 

This  causes  correlation  between  the  p "output" 
rows  of  matrix  X,  since  they  are  formed  by  delayed 
values  of  the  output  (see  Equation  3).  The  over- 
all result  Is  a deterioration  in  estimation  per- 
formance as  the  sample  rate  Is  Increased.  On  the 
other  hand,  a decrease  In  sample  rate  results  In 
deterioration  In  estimator  performance  due  to  the 
loss  of  dynamic  Information.  These  results  were 
confirmed  experimentally,  as  shown  In  Figure  A, 
which  Illustrates  the  effect  of  sample  rate  oA  the 
number  of  samples  to  convergence  for  a given  esti- 
mation error  fraction.  Fortunately,  the  optimum 
sample  rate  Is  not  a single  value  but  a range 
which  appears  as  a band  on  the  time  spectrum  from 
roughly  T • 0.5  to  T - 1.25.  In  addition,  excel- 


Parameter Tracking 

The  dynamic  IV  algorithm  of  Equations  11-13  was 
studied  to  determine  the  parameter  tracking 
ability  of  a nonstationary  system.  The  second- 
order  example  of  the  previous  sections  was  initi- 
ated and  the  gain,  k,  was  instantaneously  doubled 
after  500  samples.  The  algorithm  was  therefore 
required  to  follow  two  separate  step  changes  In 
two  of  the  parameters  of  the  model.  The  first 
step  exercises  the  Initial  "locking”  of  the  algo- 
rithm and  the  second  step.  Initiated  at  the  500th 
sample,  requires  the  algorithm  to  track  an  abrupt 
change  in  two  of  the  plant  parameters.  The  ini- 
tial estimate  of  the  parameter  vector  was  taken 

to  be  zero. 

The  two  difference  equation  parameters  affected  by 
the  process  gain  are  parameters  bj^  and  bj  which 


S 


are  directly  proportional  to  k.  The  matrix  D of 
Equation  12  was  chosen  to  be  the  diagonal  matrix 


where  d was  varied  in  the  study  to  demonstrate  its 
effect  on  tracking.  With  d - 0 the  dynamic  algo- 
rithm reduces  to  the  static  form  of  Equation  8 and 
9. 

Figures  6 and  7 show  the  excellent  tracking  per- 
formance of  the  IV  method  for  random  measurement 
noise  with  a standard  deviation,  ov,  equal  to 
0.0125  which  corresponds  to  a noise-to-signal 
ratio  of  0.0655  for  the  first  500  samples.  The 
parameter  d is  indicative  of  the  algorithm's 
memory  as  is  demonstrated  in  both  figures.  In 
practice,  d would  be  selected  experimentally  on 
the  basis  of  desired  speed  of  response  and  the 
opposing  smoothness.  As  the  level  of  measurement 
noise  is  increased,  the  IV  estimates  become  pro- 
portionately more  erratic.  This  is  due  to  the 
shorter  memory  of  the  dynamic  estimator.  Results 
were  similar  for  the  case  in  which  all  four  model 
parameters  were  tracked  with  D * dl,  as  the  ratio 
of  the  time  constants,  which  affects  all  four 
parameters,  was  changed  after  500  samples. 

Plant  Disturbances 


method  will  not  be  efficient  in  this  Instance 
because  it  has  dealt  only  with  one  of  the  diffi- 
culties and  has  not  corrected  the  autocorrelation 
of  the  disturbance. 

Summary 

A sequential  technique  for  estimating  the  param- 
eters of  a difference  equation  model  of  a process 
subject  to  noise  has  been  presented  for  the  open- 
loop  configuration.  The  technique  requires  no 
assumptions  to  be  made  on  the  noise  statistics 
and  preserves  much  of  the  simplicity  of  least- 
squares  estimation  while  dealing  effectively  with 
measurement  noise. 

The  method  was  applied  to  a deterministic  second- 
order  example  to  illustrate  its  performance  in 
comparison  to  LS  estimation  and  to  study  the 
selection  of  various  parameters  to  be  used  in  its 
implementation.  Demonstration  was  given  on  the 
parameter  tracking  capability  of  the  dynamic  form 
of  the  IV  estimator.  The  dynamic  algorithm  is 
important  for  U6e  in  an  adaptive  control  strategy. 
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To  this  point,  consideration  has  been  limited  to  a 
deterministic  system  disturbed  only  by  measurement 
noise.  More  specifically,  w^  in  Figure  1 has  been 
considered  to  be  zero  and  attention  has  been 
focusea  in  the  wn  term  which  represents  measure- 
ment noise.  It  will  be  of  interest  in  this  sec- 
tion to  drop  the  measurement  noise  term  and 
examine  the  single  effect  of  plant  disturbances, 
in  this  instance,  the  second-order  example  is  no 
longer  deterministic  for  it  is  now  considered  to 
be  stochastic. 


For  the  case  where  the  plant  disturbances  are 
white  noise,  the  estimation  problem  fulfills  all 
of  the  assumptions  of  the  LS  estimator  in  the 
probability  limit  and  that  estimator  is  therefore 
the  optimal  estimator.  Although  the  LS  estimator 
is  not  biased  in  this  case,  as  less  of  the  output 
yt  is  explained  by  the  explanatory  variable  ut, 
then  the  variances  of  the  estimates  Increase  and 
the  estimator  performance  decreases.  This  point 
is  especially  important  for  closed-loop  estimation. 
The  results  for  the  IV  estimator  in  this  case  are 
not  significantly  different. 

Figure  8 illustrates  the  effect  of  autocorrelated 
plant  disturbances  for  IV  estimation.  The  auto- 
correlation factor,  sj,  is  a measure  of  the 
correlation  from  one  sample  to  the  next  according 
to  the  expression 


•'lVi  + vt 


(16) 


Notation 

a model  output  parameters 

b model  input  parameters 

c true  system  output 

d element  of  lower  bound  matrix 

D (nxn)  lower  bound  matrix 

E expected  value  operator 

I identity  matrix 

K total  number  of  observations 

k gain 

M dead  time 

N auxiliary  model  update  delay 

n system  order  (p  + q) 

p number  of  output  parameters 

P (nxn)  weighting  matrix 

q number  of  input  parameters 

q£  ^ (lxn)  random  disturbance  vector 
s^  autocorrelation  factor 

T sample  interval 

t time  index 

u control  variable 

vC  white  noise 

w‘  combined  or  theoretical  disturbance  term 

(lxK)  vector  of  disturbances 
x^  (nxl)  vector  of  passed  Inputs  and  outputs; 
exogenous  variable 
(nxK)  observation  matrix 
y disturbance-corrupted  output;  endogenous 

variable 

Yr  (lxK)  vector  of  outputs 

Zj.  (nxX)  instrumental-variable  matrix 

(nxl)  instrumental  variable  vector 


The  combination  of  autocorrelated  plant  distur- 
bances and  lagged  values  of  the  input  and  output 
cause  the  LS  estimator  to  become  Inconsistent  (4). 
On  the  other  hand,  Figure  8 is  evidence  that  the 
IV  estimator  is  capable  of  maintaining  consistent 
estimates  because  it  can  effectively  correct  the 
problem  associated  with  the  correlated  errors  con- 
tained in  the  lagged  variables.  However,  the  IV 


a initial  diagonal  element  of  P0 
i noise-to-signal  ratio;  Kronecker  delta 

function 

e estimation  error  fraction 

i auxiliary  model  output 

o‘  standard  deviation 

t time  constant 

(lxn)  vector  of  model  parameters 


6 


Literature  Cited 

1.  Smith,  C.  L.,  Digital  Computer  Process  16. 

Control.  Intext,  Scranton,  Penn.,  1972. 

2.  Young,  P.  C.,  "Regression  Analysis  and 

Process  Parameter  Estimation:  ...  a 17. 

Cautionary  Message",  Simulation.  Vol.  10, 

No.  3,  March  1968. 

3.  Kendall,  M.  G.  and  A.  Stuart,  The  Advanced 

Theory  of  Statistics.  Vol.  2,  Griffin,  London,  18. 
1961. 

A.  Johnston,  J. , Econometric  Methods.  2nd  Ed. , 
McGraw-Hill,  New  York,  1972. 

19. 

5.  Has tings- James , R.  and  M.  W.  Sage,  "Recursive 
Generalized-Least-Squares  Procedure  for 
Online  Identification  of  Process  Parameters", 
Proceedings,  Institution  of  Electrical 

Engineers . Vol.  116,  No.  12,  Dec.,  1969,  20. 

pp.  2057-2062. 

6.  Isermann,  R. , U.  Baur,  W.  Bamberger,  P. 

Kneppo  and  H.  Siebert,  "Comparison  of  Six  21. 

On-Line  Identification  and  Parameter 
Estimation  Methods",  Automatics . Vol.  10, 

No.  1,  Jan.  1974,  pp.  81-103. 

22. 

7.  Saridis,  G.  N.,  "Comparison  of  Six  On-Line 
Identification  Algorithms",  Automatics.  Vol. 

10,  No  1,  Jan.  1974,  pp.  69-79. 

8.  Reiersol,  0.,  "Confluence  Analysis  by  Means 
of  Lag  Moments  and  Other  Methods  of 
Confluence  Analysis",  Econometrics.  Vol.  9, 

No.  1,  1941,  pp.  1-23. 

9.  Durbin,  J.,  "Errors  in  Variables",  Review  of 
Int.  Statist.  Inst..  Vol.  22,  No.  23,  1954. 

10.  Joseph,  P.  J.,  Lewis  and  J.  Tou,  "Plant 
Identification  in  the  Presence  of  Disturbances 
and  Application  to  Digital  Adaptive  Systems", 
Transactions  AIEE.  Vol.  80,  1961,  pp.  18-24. 

11.  Andeen,  R.  E.  and  P.  P.  Shipley,  "Digital 
Adaptive  Flight  Control  System  for  Aerospace 
Vehicles".  AIAA  Journal.  Vol.  1,  No.  5,  May 
1963,  pp.  1105-1109. 

12.  Levadi,  V.  S.,  "Parameter  Estimation  of 
Linear  Systems  in  the  Presence  of  Noise", 

Presented  at  the  1964  International 
Conference  on  Microwaves,  Circuit  Theory,  and 
Information  Theory,  September  7-11,  Tokyo, 

Japan. 

13.  Wong,  K.  Y.  and  E.  Polak,  "Identification  of 
Linear  Discrete  Time  Systems  Using  the 
Instrumental  Variable  Method",  IEEE 
Transactions  on  Automatic  Control.  Vol.  AC-12, 

No.  6,  Dec.  1967. 

14.  Young,  P.  C. , "An  Instrumental  Variable 
Method  for  Real-Time  Identification  of  a 
Noisy  Process",  Automatics.  Vol  6,  1970, 
pp.  271-287. 

15.  Rowe,  I.  H.,  "A  Boot  Strap  Method  for  the 
Statistical  Estimation  of  Model  Parameters”, 
International  Journal  of  Control.  Vol.  12, 


No.  5,  1970,  pp.  721-738. 

Young,  P.  C.,  "Applying  Parameter  Estimation 
to  Dynamic  Systems  - Part  I",  Control 
Engineering . Vol.  16,  Oct.  1969. 

Lee,  R.  C.  K.,  Optimal  Estimation. 
Identification,  and  Control.  Research 
Monograph  No.  28,  M.I.T.  Press,  Cambridge, 
Mass.,  1964. 

Kalman,  R.  E.,  "A  New  Approach  to  Linear 
Filtering  and  Prediction  Problems", 
Transactions  of  the  ASME,  J.  Basic  Engr. . 

Vol.  82,  March  1960,  pp.  35-46. 

Kalman,  R.  E.  and  R.  S.  Bucy,  "New  Results  in 
Linear  Filtering  and  Prediction  Theory", 
Transactions  ASME,  J.  of  Basic  Engr.  Series  D. 
Vol.  83,  March  1961,  pp.  95-108. 

Eveleigh,  V.  W. , Adaptive  Control  and 
Optimization  Techniques.  McGraw-Hill,  New 
York,  1967. 

Davies,  W.  D.  T.,  System  Identification  for 
Self-Adaptive  Control.  Wiley-Interscience, 

New  York,  1970. 

Klein,  L.  R.,  A Textbook  of  Econometrics.  2nd 
Ed.,  Prentice-Hall,  Englewood  Cliffs,  N.J., 
1974. 


J 


J 


7 


ION  lr  THIS  PAGE  fl*h.n  Dote  Entered) 


?J  REPORT  DOCUMENTATION  PAGE 


..REPORT  MUWB8R" — " 

FOSR  -/TR  - 7 G - 1 1 7 r 


4.  TITLE  (end  Subtitle 


.PROCESS  IDENTIFICATION  UTILIZING  A ^SEQUENTIAL 

Instrumental  variable  regression  algorithm f 


».  PERFORMING  ORGANIZATION  NAME  AND  ADDRESS 

Louisiana  State  University 
Department  of  Chemical  Engineering 
Baton  Rouge,  Louisiana  70803 


IJ..  CONTROLLING  OFFICE  NAME  AND  A[}DR,ESS 

Air  Force  Office  of  Scientific  Research/NM 
Bolling  AFB,  Washington,  DC  20332 


HEAD  INSTRUCTIONS 
BEFORE  COMPLETING  FORM- 


S.  RECIPIENT'S  CATALOG  NUMBER 


S.  JTYPE  OF  REPORT  4 PERIOD  COVERED 

(p ~7  J 

Interim  / 


6.  PERFORMING  ORG:  REPO 


6.  CONTRACT  OR  GRANT  NUMBER^#; 


f'~  AFO^R  1^.2580- / 


13.  NUMBER  OF  PAGES 

9 


MONITORING  AGENCY  NAME  A AODRESSfi#  dlllotent  from  Controlling  Olllco)  I 15.  SECURITY  CLASS,  (ot  thla  report) 


/M-  /Op.  I 


UNCLASSIFIED 


toe.  OECLASSIFICATION/DOWNGRAOING 
SCHEDULE 


1«.  DISTRIBUTION  STATEMENT  (of  Ihle  Report) 


Approved  for  public  release;  distribution  unlimited. 


19.  KEY  WORDS  ( Continue  on  reeeree  aide  if  necessary  end  Identify  by  block  number) 


Identification 
Difference  equations 
Estimation 

Instrumental  Variable 


20.  ABSTRACT  (CooUlVP. an elde  » neceeeery  end  Identity  by  block  number) 

instrumental  variable  (IV)  regression  is  applied  to  the  estimation  of  the 
parameters  of  a difference  equation  model  of  a process  subject  to  noise.  The 
technique  preserves  the  simplicity  of  least-squares  estimation,  and  is  shown 
to  significantly  reduce  the  bias  on  the  parameter  estimates  caused  by  measure- 
ment noise.  A second-order  example  is  used  to  illustrate  the  performance  of 
the  IV  estimator,  and  to  study  the  selection  of  sample  time  and  initialization 
parameters.  Demonstration  is  given  on  the  parameter  tracking  capability  of  thi 
|dynaml^|form  of  the  algorithm.  The  dynamic  algorithm  is  Important  for  use  in  . 

DD  I j2nM7J  1473  edition  of  I NOV  s*  is  obsolete  UNCLASSIFIED  adaptive  control 

SECURITY  CLASSIFICATION  OF  THIS  PAGE  (When  Do ta  Entered) 


